WHAT IS CLAIMED IS: 



1 . 



Multimedia information collection control 



apparatus, comprising: 

multimedia information collection unit configured to 
collect information from more than one kind of medium; 

multimedia correspondence memory configured to 
correspondingly store multimedia information collected by 
said multimedia information collection unit; 

information recognition unit configured to recognize 
the multimedia information stored in said multimedia 
correspondence memory, and to analyze the multimedia 
information as personal data according to the recognition 
result; and 

multimedia database configured to relationally store 
the multimedia information as the personal data analyzed by 
said information recognition unit. 

2. The multimedia information collection control 
apparatus according to claim 1, 

wherein said multimedia information collection unit 
includes a camera to input an image of an object, a display 
to output the image as the information of one medium, and 
an indicator to artificially indicate a mark representing a 
recognition area as a user's desired area of the image on 
the display. 
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3 . The multimedia information collection control 
apparatus according to claim 2, 

wherein the mark includes an attribute representing a 
kind of recognition object based on a shape of the mark. 

4. The multimedia information collection control 
apparatus according to claim 3, 

wherein said multimedia correspondence memory stores 
the multimedia information in which the mark is recorded at 
the indicated area, and 

wherein said information recognition unit extracts a 
recognition object from the multimedia information 
according to the mark. 

• ■ / 

5. The multimedia information collection control 

apparatus according to claim 4, 

wherein said information recognition unit selectively 
uses a knowledge dictionary and a method used for 
recognition and analysis according to the attribute of the 
mark. 

6. The multimedia information collection control 
apparatus m according to claim 4, 

wherein said information recognition unit includes a 
character recognition unit configured to recognize 



# 



characters in the image, and 

wherein said multimedia database stores the 
recognition result of said character recognition unit as 
one of the multimedia information. 

7 v The multimedia information collection control 
apparatus according to claim 4, 

wherein said information recognition unit includes a 
speech recognition unit configured to recognize speech 
collected by said multimedia information collection unit 
and 

wherein said multimedia database stores the 
recognition result of said speech recognition unit as one 
of the multimedia information. 

8. The multimedia information collection control 
apparatus according to claim 4, 

wherein said information recognition unit includes a 
face recognition unit configured to recognize a face area 
in the image, and 

wherein said multimedia database stores the 
recognition result of said face recognition unit as one of 
the multimedia information. 

9. The multimedia information collection control 
apparatus according to claim 6, 
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wherein said information recognition unit includes a 
person 1 s name extraction unit configured to extract a 
person's name from the recognition result of said character 
recognition unit, and 

wherein said multimedia database stores the person's 
name as a title of corresponding multimedia information. 

10. The multimedia information collection control 
apparatus according to claim 7, 

wherein said information recognition unit includes a 
speaker recognition unit configured to identify a speaker 
from the speech collected by said multimedia information 
collection unit, and 

wherein said multimedia database stores the multimedia 
information corresponding to the speaker by referring to 
the identification result of said speaker recognition unit. 

11. The multimedia information collection control 
apparatus according to claim 4, 

wherein said multimedia database correspondingly 
stores an index name representing each kind of stored 
multimedia information. 

12. ,The multimedia information collection control 
apparatus according to claim 11, 

wherein said multimedia information collection unit 



includes an information addition unit to additionally input 
the multimedia information to said multimedia database, and 

wherein said multimedia data additionaly stores the 
multimedia information corresponding to the index name. 

13. The multimedia information collection control 
apparatus according to claim 11, 

further comprising a dialogue control unit configured 
to input a retrieval sentence from a user, to analyze the 
retrieval sentence, and to generate a retrieval key 

r 

according to the analysis result. 

14. The multimedia information collection control 
apparatus according to claim 13, 

further comprising a retrieval control unit configured 
to retrieve the multimedia database by comparing the 
retrieval key with the multimedia information of each index 
name, and 

wherein said multimedia information collection unit 
presents the retrieved information through the display. 

15. A method for controlling collection of multimedia 
information, comprising the steps of: 

collecting information from more than one kind of 
medium; 

correspondingly storing multimedia information 
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collected at the collecting step; 

recognizing the multimedia information stored at the 
storing step; 

analyzing the multimedia information as personal data 
according to the recognition result; and 

relationally storing the multimedia information as the 
personal data analyzed at the analyzing step. 

16. The method according to claim 15, 

wherein the collecting step includes the steps of: 
inputting an image of an object; 

displaying the image as the information of one medium; 

and 

artificially indicating a mark representing a 
recognition area as a user's desired area of the displayed 
image. 

17. The method according to claim 16, 

wherein the mark includes an attribute representing a 
kind of recognition object based on a shape of the mark. 

18. The method according to claim 17, 

wherein the correspondingly storing step includes the 
step of : 

storing the multimedia information in which the mark 
is recorded at the indicated area, and 
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wherein the recognizing step includes the step of: 
extracting a recognition object from the multimedia 
information according to the mark. 

19. A computer readable memory containing computer 
readable instructions to control collection of multimedia 
information, comprising: 

an instruction means for causing a computer to collect 
information from more than one kind of medium; 

an instruction means for causing a computer to 
correspondingly store multimedia information collected; 

an instruction means for causing a computer to 
recognize the multimedia information stored; 

an instruction means for causing a computer to analyze 
the multimedia information as personal data according to 
the recognition result; and 

an instruction means for causing a computer to 
relationally store the multimedia information as the 
personal data analyzed. 

20. The computer readable memory according to claim 

wherein the first instruction means includes: 
an inststruction means for causing a computer to input 
an image of an object; 

an inststruction means for causing a computer to 
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display the image as the information of one medium; and 

an inststruction means for causing a computer to 
artificially indicate a mark representing a recognition 
area as a user's desired area of the displayed image. 

21. The computer readable memory according to claim 

20/ 

wherein the mark includes an attribute representing a 
kind of recognition object based on a shape of the mark. 

22. The computer readable memory according to claim 

21, 

wherein the second instruction means includes: 

an instruction means for causing a computer to store 
the multimedia information / in which the mark is recorded at 
the indicated area, and 

wherein the third instruction means includes; 

an instruction means for causing a computer to extract 
a recognition object from the multimedia information 
according to the mark. 



